Goto

Collaborating Authors

 gan-generated face


Characteristics and prevalence of fake social media profiles with AI-generated faces

Yang, Kai-Cheng, Singh, Danishjeet, Menczer, Filippo

arXiv.org Artificial Intelligence

Recent advancements in generative artificial intelligence (AI) have raised concerns about their potential to create convincing fake social media accounts, but empirical evidence is lacking. In this paper, we present a systematic analysis of Twitter(X) accounts using human faces generated by Generative Adversarial Networks (GANs) for their profile pictures. We present a dataset of 1,353 such accounts and show that they are used to spread scams, spam, and amplify coordinated messages, among other inauthentic activities. Leveraging a feature of GAN-generated faces -- consistent eye placement -- and supplementing it with human annotation, we devise an effective method for identifying GAN-generated profiles in the wild. Applying this method to a random sample of active Twitter users, we estimate a lower bound for the prevalence of profiles using GAN-generated faces between 0.021% and 0.044% -- around 10K daily active accounts. These findings underscore the emerging threats posed by multimodal generative AI. We release the source code of our detection method and the data we collect to facilitate further investigation. Additionally, we provide practical heuristics to assist social media users in recognizing such accounts.


Hot papers on arXiv from 2021

AIHub

Reproduced under a CC BY 4.0 license. We've collated the most tweeted papers for each month that were uploaded onto arXiv during 2021. Results are powered by Arxiv Sanity Preserver. Abstract: Large-scale model training has been a playing ground for a limited few requiring complex model refactoring and access to prohibitively expensive GPU clusters. ZeRO-Offload changes the large model training landscape by making large model training accessible to nearly everyone.


Hot papers on arXiv from the past month: September 2021

AIHub

Comparing the visual quality of generated frames. From Diverse Generation from a Single Video Made Possible. Reproduced under a CC BY 4.0 license. Here are the most tweeted papers that were uploaded onto arXiv during September 2021. Results are powered by Arxiv Sanity Preserver. Abstract: Generative adversary network (GAN) generated high-realistic human faces have been used as profile images for fake social media accounts and are visually challenging to discern from real ones.